Recording a signature on a touch screen enabled wireless phone and mobile device with stylus and server

ABSTRACT

A cellular phone and mobile device is configured with the ability to accept a signature. A user may write a signature on a touch sensitive display of a mobile device using touch or a pen. A user may be further authenticated by using voice or password. Software for recognizing a finger print could reside on a network server or on the hand held device. Handwriting recognition can be used for authentication. The signature may be viewed on a second mobile device in real time. The signature may be synchronized with a server or an Internet device. The system may allow for multiple parties to sign an electronic document using mobile devices and Internet servers.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of U.S. application Ser. No.14/328,655, filed on Jul. 10, 2014, which is a continuation of Ser. No.13/555,124 filed on Jul. 21, 2012, now U.S. Pat. No. 8,781,534 which isa continuation of U.S. application Ser. No. 10/878,666 filed Jun. 28,2004, which is a continuation of U.S. application Ser. No. 09/597,607filed Jun. 20, 2000, now U.S. Pat. No. 6,882,859; the disclosures of allthe above patents and applications are herein incorporated by referencein their entirety.

BACKGROUND OF THE INVENTION

Currently the key pad buttons on a cellular telephone/mobile device(CT/MD) pose a limitation in inputting broad based queries. There areonly 12 non-control buttons on many CT/MDs. Even where there are more,there are so few that inputting even as little as the letter-numberASCII set is not really practical. For example, in the present art therehave been attempts to expand the number of keys, such as treating thenumeric keys as numbers unless a code is entered, such as A*#@ or thelike, then treating a A2″ as an Aa@, A2-2″ as a Ab@, and A2-2-2″ as aAc@. Entering A2″ three times to form a Ac@ is both confusing and slow,and such approaches have not been popular. If a mixed string of lettersand numbers are desired, the three A2″s may have to be delimited with,for example, A*#@, and the process becomes increasingly more unwieldy.There has been some success in using a computer, especially a computeroperating with Afuzzy@ logic, to extract the probable combination ofletters in a numeric string, exemplified by an interactive directory forfinding the telephone extension number of an employee by Aspelling@ theemployee's name on a numeric key pad. This is a satisfactory solutiononly in limited cases. Numeric reduction of this type has not beengenerally used except for telephone directories and similar purposes.

SUMMARY OF THE INVENTION

It is an object of the present invention to provide a scheme by whichthe limitations of a key pad are overcome and the key pad is enhanced.The scheme uses a local or network server.

The protocols for configuring each key to a specific function orvariable set of functions are stored in a Server C. The protocols forall keys may be stored on Server C similarly. The menu for any macrofunction can be stored on this Server C. Server C may be part of a localloop or located on the internet.

In an embodiment of the present invention, displays, such as small LCDdisplays, are mounted on the top of the keys and connected to a matrixaddressing system. When a key is reconfigured, such as from an Englishlanguage AA@ to some Japanese character, the legend displayed on the keywith the small display is changed accordingly.

In another embodiment of the present invention, the keyboard isdisplayed in the display window of a computing device, such as a handheld wireless device. The term wireless device includesentertainment/game machines. The screen of the wireless device is touchsensitive, so the user can type on the screen as if it were a standardkeyboard.

In another embodiment of the present invention, the keyboard isdisplayed on a separate screen in the position of and replacing thekeyboard on a device, such as a hand held wireless device. This screenis touch sensitive, so the user may type on it as if it were a keyboard.

In another embodiment of the present invention, the keys on any of theabove keyboards, as well as on keyboards of the present inventiongenerally, have a sound output, such as a voice output. In this wayvisually impaired or persons with similar concerns can listen to whatkeys are being depressed.

Other objects, features and advantages of the present invention willbecome apparent from the following detailed description when taken inconjunction with the accompanying drawings.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING

The accompanying drawings, being incorporated in and forming a part ofthis specification, illustrate embodiments of the invention and,together with the description, serve to explain the principles of thepresent invention:

FIG. 1 is an embodiment of the present invention showing a CT/MD with areconfigurable keyboard communicating with a Central Server C.

FIG. 2 is an embodiment of the present invention showing a CT/MD withdisplay devices on the keys for defining the function of the keydynamically.

FIG. 3 is an embodiment of the present invention showing a key with ascreen or display thereon for containing a legend.

FIG. 4 is an embodiment of the present invention showing a wirelessdevice having a screen for containing a keypad which is accessed by apointer, such as a stylus.

FIG. 5 is an embodiment of the present invention showing a wirelessdevice having a microphone for allowing voice entries for languagetranslation.

FIG. 6 is an embodiment of the present invention showing how users ofthe present invention who are physically separated can collaborate in asigning ceremony.

DETAILED DESCRIPTION OF THE INVENTION

The present invention provides means for more easily and intuitivelyassigning, for example, key values to a wireless device such as to a keyassociated with the wireless device. The present invention also providesmeans for compressing or expanding the keys on an entry system such as awireless device or wireless computing device to more efficiently providekeys needed for entry or other reasons, such as sound, in a desiredspace.

The present invention uses a Central Server C providing the softwareroutines and other support for realizing the improved input key meansfor a wireless device or for a wireless computing device.

Thus the Server C contains a number of menus for different applicationscomprising of assigned values for each key function.

1. Individual Key→may take one or more values that are programmable.

2. Full set or subset of keys→may take one or more values that areprogrammable.

3. The individual or subset or full set of keys→is programmable toperform assigned functions.

4. The above individual or subset or full set of keys in combination maycomprise a menu to perform various customizable functions.

5. The identity of each programmed value for a key, set of keys or fullset of keys is stored in the Server C.

6. The menus, sub menus and individual key functions are stored inServer C and may be accessed for use by wired or wireless means. Theycan be dynamically changed as defined by the user=s needs.

7. The user may easily go from one set of functions or menus to anotherset of functions or menus by selecting an option from the CT/MD.

8. The menus or functions may coexist on the CT/MD. One function or menumay go to the background and one may be in the foreground. One set maybe primary and the others secondary or a hierarchy of functions/menusmay be maintained, such as with a windowing of templates, where the usermay change templates in the same manner as changing windows on apersonal computer (PC).

9. Server C manages the delivery of these functions to the CT/MD andalso maintains a history.

10. This same process is extendible to pen based inputs where certainfigures or icons or strokes may be designated to indicate certainfunctions or menus that we stored on the Server C and delivered asneeded by a command from the CT/MD.

11. This same process is extendible to voice based input commands andoutput where each voice command or output means a certain function or amenu that is stored in Server C. The voice recognition function inaddition may add more functionality to respond to a given voice. Thevoices may be in different languages.

12. The same process may be extendible to sounds rather than voice; forexample, the sound of a bell.

In addition the CT/MD may contain electronics and process capability tointernally store the various programmable key functions or menus suchthat different functions and menus may be chosen as the need arises.

In addition, the web server may be shrunk into a microchip that can bepart of the internal electronics of the CT/MD, in which case a local ornetwork server may or may not be needed. In this event the featuresdescribed above for programming and describing each key or input/outputcould be handled by the internal web server independently or inconjunction with a local or network Server C.

If a user initiates communication with a particular device, i.e., if auser selects a particular device, the system may understand the contextand may change the keypad automatically. Thus the system may performcontext-aware keypad changes. This context may be based upon location,the devices communicated with, devices present in its local environment,or other factors

FIG. 1 illustrates a wireless system 100 with a CT/MD 102 having adynamically reconfigurable keypad 104. Such a keypad 104 provides theability to define macro keys not included with the standard alphanumerickeypad. In FIG. 1, a CT/MD 102 which seems standard has display devicesmounted on each key 106, so that the legend appearing on the key 106 isconfigurable in software such as from Central Server C 108 withoutrequiring external physical changes.

FIG. 2 illustrates a wireless device 200 such as a CT/MD having adisplay 202 and a key pad 204. The key pad 204 has keys such as key 206which are assignable as desired in software.

The user may choose to reassign a key on the wireless device torepresent a particular function. For example, the user could assign akey to serve as a garage door opener. The user may also use thisfunctionality for universal language capability, such as to change anEnglish keypad to serve as a Japanese keypad. The display mounted on thekey may be used to change the keypad template, such as by introducing aJapanese character on the key replacing the English letter AA@ or amacro such as “open garage door”.

FIG. 3 shows an embodiment of the present invention in the form of a key300 such as a key that might be found on a multifunction keyboard. InFIG. 3, the key 300, such as a key from a multi-function keypad, iscomposed of a liquid crystal display (LCD) which can be modified withelectrical inputs only. In this manner, as new templates are used, thekey 300 will immediately reflect these changes. Thus, when a key 300 isreassigned a new name and function, the key=s new name can becomeapparent to the user as a legend 302 on the key 300 itself.

The LCD or similar display need not form a part of the key. A clearbutton made of, for example, plastic may encase a LCD type display whichmay or may not be touch sensitive; that is, a touch sensitive LCD. Asnew templates are loaded, the LCD display is modified to reflect thesechanges.

FIG. 4 shows an embodiment of the present invention with a CT/MD 400.FIG. 4 shows the CT/MD 400 having a dynamic key pad 402 such as a touchsensitive LCD panel. The CT/MD 400 optionally includes a liquid crystaldisplay (LCD) 404. If a writing area is present then new templates canbe loaded with, for example, selectable icons, and a stylus 406 can beused to choose the various keys.

Server Based, Remote Handwriting Recognition.

Handwriting recognition may be processing intensive. Wireless devicesmay not have the processing capability to perform advanced handwritingrecognition techniques within a reasonable time. The wireless devicescan offload handwriting recognition functions to a central server. Theserver may then transmit the recognized characters back to the wirelessdevice, such as screen 402.

This could serve also as a signature authentication or finger printauthentication mechanism. A scanner could be used to perform fingerprint authentication. Such authentication could take place remotely on aCentral Server C 108.

FIG. 5 illustrates a wireless system 500 which is an embodiment of thepresent invention. In FIG. 5, a wireless device 502 transmits an imageof the text that has been captured from the writing area 504. This maybe a bit map image or it could be in a standard format that both thewireless device 502 and Central Server C 508 understand.

The wireless device 502 establishes a wireless connection with theCentral Server C 508 and transmits the image in a standard format. TheServer C 508 then performs the processing on the image and converts itinto a format of standard recognized characters which the wirelessdevice 502 understands. The server 508 thus takes an image format of theinputted information and converts it into another format of knowncharacters. After this processing is complete the server C 508 can thentransmit the converted format back to the wireless device 502. Theserver C 508 could also perform language translation on the inputtedinformation. A microphone 506 at the wireless device 502 accepts voice.Voice clips may be transferred to the server 508 and converted to textusing voice recognition software at the server 508. Alternatively,language translation may be performed on the voice file for voice basedlanguage translation. After the server 508 has performed theseprocessing steps, voice files or text may be sent back to the wirelessdevice 502.

The system 500 can also be used for user authentication such as withfinger print, eye print, or password authentication.

Authentication:

Additionally, the key pad 400/stylus 406 interface could be redefined sothat a finger print could be taken for image authentication. This imagewould be used, for example, for user authentication. The software forrecognizing a finger print could reside on a network server 508 or onthe hand held device 502.

The present invention allows for handwriting recognition and can be usedfor authentication. The recognition software can be on the networkserver or on the hand held device. The present invention also allows forthe person to speak to a cell phone/hand held device and access remotemacros. For example, by stating Aopen garage@. This command couldconnect to a network server 508 which would then authenticate the voice.Since voice recognition could be burdensome, this operation could beperformed on a networked server 508 or on the hand held device 502. Oncethe voice has been recognized through voice recognition software, thecommand will be performed.

In FIG. 6, an embodiment of an input pad such as a touch sensitivescreen 600 of another part of the invention allows for collaborating.The present invention allows screens such as screen 600 to be viewedinteractively for interacting from separate devices. For example, ifthree screens such as screens 602-1, 602-2, 602-3 are used to sign adocument from different places, signatures 602 can be on separatescreens 600 and optionally displayed on other screens as well. Eachscreen can be watched separately, with signing being done in parallel orsequentially on the separate screens. This allows the signaturesdisplayed on screens 602 to be placed on a virtual document 604 forinteractive verification. Each signature displayed on screens 602 canhave a different trust level. The escrow agent is Server C 508.

The present invention has been described with a number of features andadvantages. For example, one embodiment of the present inventionprovides a keyboard device including a a plurality of configurable keysand a central server where the central server includes means fordynamically configuring a legend on a selected key from the configurablekeys, means for detecting an actuation (selection) of the selected keywith the legend, and means for associating the actuation of the selectedkey with the legend on the selected key. The central server could beremote or local to the keyboard device.

The keys in the keyboard typically could be LCDs for displaying therespective legends, and desirably are touch sensitive.

The keyboard device could be voice based, sound based or macro based,including key, sound or voice. The keyboard device could be wireless,such as a cellular telephone or mobile device. The keyboard device couldbe non-wireless.

The foregoing descriptions of specific embodiments of the presentinvention have been presented for purposes of illustration anddescription. They are not intended to be exhaustive or to limit theinvention to the precise forms disclosed, and it should be understoodthat many modifications and variations are possible in light of theabove teaching. The embodiments were chosen and described in order tobest explain the principles of the present invention and its practicalapplication, to thereby enable others skilled in the art to best utilizethe present invention and various embodiments, with variousmodifications, as are suited to the particular use contemplated. It isintended that the scope of the invention be defined by the Claimsappended hereto and their equivalents.

What is claimed is:
 1. An electronic signature system using a server anda plurality of multifunction mobile devices, the system comprising: aserver, wherein a portion of a display of a multifunction mobile deviceis configured to accept a signature, wherein the signature is entered byphysical touch with the display, wherein a document displayed on themultifunction mobile device is further configured with a first signatureentry location, a second signature entry location, a third signatureentry location; wherein a first signature, a second signature, and athird signature are associated with and displayed on three multifunctionmobile devices respectively; and wherein signing is done in parallel orsequentially on separate screens amongst the three multifunction mobiledevices such that the signatures are placed on a virtual document forinteractive verification; and wherein authentication is enabled by afinger print authentication mechanism.
 2. The system of claim 1 furthercomprising an escrow server, wherein the escrow server is configured toreceive said signatures from a first multifunction mobile device and asecond multifunction mobile device.
 3. The system of claim 1 whereineach of the signatures recorded by a first multifunction mobile deviceand a second multifunction mobile device are viewable simultaneously. 4.The system of claim 1, wherein each signature is used to sign a documentin different places.
 5. A system for recording one or more signatures,the system comprising: a server programmed to provide routines for useby a multifunction mobile device having one or more processors and auser input feature, wherein the server synchronizes signatures, whereinthe server is in communication with the multifunction mobile device suchthat the server is programmed to receive a first signature recorded in afirst signature entry location of the multifunction mobile device, asecond signature recorded in a second signature entry location of asecond multifunction mobile device, and a third signature recorded in athird signature entry location of a third multifunction mobile device,wherein each signature is displayed on the first, second, and thirdmultifunction mobile devices, wherein each signature is used to sign adocument in different places, and wherein signing is done in parallel orsequentially on separate screens amongst the three multifunction mobiledevices such that the signatures are placed on a virtual document forinteractive verification; wherein authentication is enabled by a fingerprint authentication mechanism; and wherein the mobile device acceptsstylus input.
 6. The system of claim 5, wherein the server synchronizeseach signature in parallel or sequentially on two or more multifunctionmobile phones such that the signatures are placed on a virtual documentfor interactive verification.
 7. The system of claim 5, wherein each ofthe signatures recorded by a first multifunction mobile device and asecond multifunction mobile device are viewable simultaneously.
 8. Thesystem of claim 7, wherein a touch sensitive keyboard is displayed in awindow of the multifunction mobile device.
 9. The system of claim 8,wherein the multifunction mobile device further comprises a eye printauthentication mechanism.
 10. A method for recording one or moresignatures, comprising: recording a first signature in a first signatureentry location displayed on a first mobile device, a second signature ina second signature entry location displayed on a second mobile device,and a third signature in a third signature entry location displayed on athird mobile device; displaying a document on the first, second, andthird mobile devices; receiving on a server from the first, second, andthird mobile devices, each of the signatures associated with thedocument, wherein each signature is used to sign the document indifferent locations; and synchronizing signatures between the threemobile devices and the server, wherein signing is done in parallel orsequentially on separate screens amongst the three multifunction mobiledevices such that the signatures are placed on a virtual document forinteractive verification.
 11. The method of claim 10, wherein at leastone mobile device comprises one or more processors, a touch screendisplay, a keyboard, a memory, a wireless transmit and receive unit, andis capable of voice and audio functions.
 12. The method of claim 11,wherein the server is configured to receive each of the signatures fromtwo or more mobile devices.
 13. The method of claim 12, wherein theserver is configured to synchronize each signature in parallel orsequentially on the two or more mobile devices such that the signaturesare placed on a virtual document for interactive verification.
 14. Themethod of claim 10, wherein each of the signatures recorded by two ormore mobile devices are viewable simultaneously.
 15. The method of claim10, wherein a mobile device further comprises a finger printauthentication mechanism.
 16. The method of claim 15, wherein at leastone mobile device is configured to accept a pen based input.
 17. Themethod of claim 16, wherein at least one mobile device is configured forlanguage translation.
 18. The system of claim 17, wherein at leastmobile device is configured for handwriting recognition.
 19. The systemof claim 18, wherein the server manages delivery of a function andmaintains a history.
 20. The system of claim 10, wherein a keyboard isdisplayed in a window of a first mobile device, wherein a screen istouch sensitive, and wherein a user may type on the screen as if it werea keyboard.